Conversation
|
Thank you for this work @zeuner ! |
f2ee916 to
ae92fdd
Compare
In the process of doing so. When I saw 2.15.0, I had already started working on 2.14.0, so I decided to finish it first in order to get all the clang-related changes right. Hope to get it adapted to 2.15.0, soon. |
Very cool ! |
42cfe4d to
fa0d054
Compare
bb38de2 to
d50895a
Compare
0a53960 to
5b66a10
Compare
5b66a10 to
0eca56e
Compare
0eca56e to
a0a16f4
Compare
|
On my machine ERROR: /build/source/third_party/py/numpy/BUILD:5:6: //third_party/py/numpy:numpy depends on @pypi_numpy//:pkg in repository @pypi_numpy which failed to fetch. no such package '@pypi_numpy//': whl_library pypi_numpy failed: Collecting numpy==1.26.4 (from -r /build/tmparr9phrh (line 1))
Downloading numpy-1.26.4-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (14.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.2/14.2 MB 5.9 MB/s eta 0:00:00
(ERROR: THESE PACKAGES DO NOT MATCH THE HASHES FROM THE REQUIREMENTS FILE. If you have updated the package versions, please update the hashes. Otherwise, examine the package contents carefully; someone may have tampered with them.
numpy==1.26.4 from https://files.pythonhosted.org/packages/79/ae/7e5b85136806f9dadf4878bf73cf223fe5c2636818ba3ab1c585d0403164/numpy-1.26.4-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from -r /build/tmparr9phrh (line 1)):
Expected sha256 06005a2ef6014e9956c09ba07654f9837d9e26696a0470e42beedadb78c11b07
Expected or 09b7847f7e83ca37c6e627682f145856de331049013853f344f37b0c9690e3df
Expected or 0aaee12d8883552fadfc41e96b4c82ee7d794949e2a7c3b3a7201e968c7ecab9
Expected or 0cbe9848fad08baf71de1a39e12d1b6310f1d5b2d0ea4de051058e6e1076852d
Expected or 1b1766d6f397c18153d40015ddfc79ddb715cabadc04d2d228d4e5a8bc4ded1a
Expected or 33161613d2269025873025b33e879825ec7b1d831317e68f4f2f0f84ed14c719
Expected or 5039f55555e1eab31124a5768898c9e22c25a65c1e0037f4d7c495a45778c9f2
Expected or 522e26bbf6377e4d76403826ed689c295b0b238f46c28a7251ab94716da0b280
Expected or 56e454c7833e94ec9769fa0f86e6ff8e42ee38ce0ce1fa4cbb747ea7e06d56aa
Expected or 58f545efd1108e647604a1b5aa809591ccd2540f468a880bedb97247e72db387
Expected or 5e05b1c973a9f858c74367553e236f287e749465f773328c8ef31abe18f691e1
Expected or 7903ba8ab592b82014713c491f6c5d3a1cde5b4a3bf116404e08f5b52f6daf43
Expected or 8969bfd28e85c81f3f94eb4a66bc2cf1dbdc5c18efc320af34bffc54d6b1e38f
Expected or 92c8c1e89a1f5028a4c6d9e3ccbe311b6ba53694811269b992c0b224269e2398
Expected or 9c88793f78fca17da0145455f0d7826bcb9f37da4764af27ac945488116efe63
Expected or 9fad7dcb1aac3c7f0584a5a8133e3a43eeb2fe127f47e3632d43d677c66c102b
Expected or a7ac231a08bb37f852849bbb387a20a57574a97cfc7b6cabb488a4fc8be176de
Expected or abdde9f795cf292fb9651ed48185503a2ff29be87770c3b8e2a14b0cd7aa16f8
Expected or af1da88f6bc3d2338ebbf0e22fe487821ea4d8e89053e25fa59d1d79786e7481
Expected or b2a9ab7c279c91974f756c84c365a669a887efa287365a8e2c418f8b3ba73fb0
Expected or bf837dc63ba5c06dc8797c398db1e223a466c7ece27a1f7b5232ba3466aafe3d
Expected or ca51fcfcc5f9354c45f400059e88bc09215fb71a48d3768fb80e357f3b457e1e
Expected or ce571367b6dfe60af04e04a1834ca2dc5f46004ac1cc756fb95319f64c095a96
Expected or d208a0f8729f3fb790ed18a003f3a57895b989b40ea4dce4717e9cf4af62c6bb
Expected or dbee87b469018961d1ad79b1a5d50c0ae850000b639bcb1b694e9981083243b6
Expected or e9f4c4e51567b616be64e05d517c79a8a22f3606499941d97bb76f2ca59f982d
Expected or f063b69b090c9d918f9df0a12116029e274daf0181df392839661c4c7ec9018a
Expected or f9a909a8bae284d46bbfdefbdd4a262ba19d3bc9921b1e76126b1d21c3c34135
Got 7ab55401287bfec946ced39700c053796e7cc0e3acbef09993a9ad2adba6ca6eFor non-cuda aarch64-linux ofborg produces different hash error: hash mismatch in fixed-output derivation '/nix/store/g0lmxrr2msf250zj1ripy0rv7kywz2dm-tensorflow-2.14.0-deps.tar.gz.drv':
specified: sha256-Vu4pk5J98zTHBzyLSHdaioqo64cnfCfRQHUX91wEbgM=
got: sha256-T3X88roRW9+kUCwaftz1GdjxkxffLSF1VcPMoICNhlg=will try to build that one too one my machine |
|
For error: build of '/nix/store/v8xlwfxq5yd0515rv6lhlbanhwgnw704-tensorflow-2.14.0-deps.tar.gz.drv' on 'ssh-ng://khadas' failed: error: hash mismatch in fixed-output derivation '/nix/store/v8xlwfxq5yd0515rv6lhlbanhwgnw704-tensorflow-2.14.0-deps.tar.gz.drv':
specified: sha256-Vu4pk5J98zTHBzyLSHdaioqo64cnfCfRQHUX91wEbgM=
got: sha256-x62qm084a06fvKxL4W8LL6iMBSWoBphAyRksvSk/bvk=And for INFO: Repository local_config_cuda instantiated at:
/build/source/WORKSPACE:84:14: in <toplevel>
/build/source/tensorflow/workspace2.bzl:1020:19: in workspace
/build/source/tensorflow/workspace2.bzl:105:19: in _tf_toolchains
Repository rule cuda_configure defined at:
/build/source/third_party/gpus/cuda_configure.bzl:1490:33: in <toplevel>
ERROR: An error occurred during the fetch of repository 'local_config_cuda':
...
ERROR: @local_config_cuda//:enable_cuda :: Error loading option @local_config_cuda//:enable_cuda: Repository command failed
/build/output/external/local_config_cuda/script.py:124: SyntaxWarning: invalid escape sequence '\s'
match = re.match("\s*#\s*define %s\s+(\d+)" % name, line)
/build/output/external/local_config_cuda/script.py:263: SyntaxWarning: invalid escape sequence '\d'
pattern = "Cuda compilation tools, release \d+\.\d+, V(\d+\.\d+\.\d+)"
/build/output/external/local_config_cuda/script.py:552: SyntaxWarning: invalid escape sequence '\w'
match = re.match("^(/[^/ ]*)+/lib/\w+-linux-gnu/?$", os.environ[env_name]) |
e32f5d7 to
b3b8512
Compare
Thanks, learned something new. I "enabled" |
Thanks! Added the missing
I wasn't able to reproduce the deps hash instability on |
Fixed the error related to Python 3.12 string syntax. I think it builds now. Please note that upstream tensorflow 2.14 doesn't support Python 3.12, so we might drop it if keeping it creates too much hassle. |
|
b3b8512 to
f1ac8fe
Compare
Yes, they are slightly different. |
|
|
aarch64-linux hash $ nix-build --system aarch64-linux -A python312Packages.tensorflowWithCuda
...
error: hash mismatch in fixed-output derivation '/nix/store/dkh4r650lvmkwgc1vgbnn61gdwpiif0k-tensorflow-gpu-2.14.0-deps.tar.gz.drv':
specified: sha256-AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=
got: sha256-9Al7JH93Q7D0xN5sjtk5VvZH+ge13nnMJOC8Py5f96g= |
|
Got local mismatch without cuda $ nix-build --system aarch64-linux -A python312Packages.tensorflow -j0
...
error: hash mismatch in fixed-output derivation '/nix/store/icicrg8manx86yywyyf0d833ckxnb9za-tensorflow-2.14.0-deps.tar.gz.drv':
specified: sha256-ktEpU1YyedNpssuJTqsqS+XeY5NFNFnH1fuHsm4NRSY=
got: sha256-85xKq/gKO9Klt56OBCowTFhYvz+61vSofODFGUio17s=it is possible to download ofborg-built outputs? |
Yes... in our case, the thing is that Not sure whether this is sensible, though. Maybe it slipped through when I considered the global push for preferably using |
These confuse me a bit. AFAICS, |
Good question! @NixOS/infra any ideas regarding this? |
Thanks, added. |
f1ac8fe to
a73d6df
Compare
I could also build it here on with this PR merged. |
|
Figured out that |
|
ofborg reports the hash to be |
|
The CI might require merging #437407 before. |
Description of changes
Updated the version and adapted scripts and patches to make it build. Basic tests also succeeded. There remains a warning about
ml_dtypes, which might be expected (see #258546 (comment))Things done
nix.conf? (See Nix manual)sandbox = relaxedsandbox = truenix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage./result/bin/)Add a 👍 reaction to pull requests you find important.